Vector Exponential Models and Second Order Inference
نویسندگان
چکیده
منابع مشابه
Robust Second Order Accurate Inference for Generalized Linear Models
Generalized linear models have become the most commonly used class of regression models in the analysis of a large variety of data. In particular, generalized linear model can be used to model the relationship between predictors and a function of the mean of a continuous or discrete response variable. The estimation of the parameters of the model can be carried out by maximum likelihood or quas...
متن کاملSecond-order stochastic variational inference
Stochastic gradient descent (SGD), the workhorse of stochastic optimization, is slow in theory (sub-linear convergence) and in practice (thousands of iterations), intuitively for two reasons: 1) Its learning rate schedule is fixed a priori and decays rapidly enough to 0 that is square-summable. This learning rate schedule limits the step size and hence the rate of convergence for a Lipschitz ob...
متن کاملGraphical Models, Exponential Families, and Variational Inference
The formalism of probabilistic graphical models provides a unifying framework for capturing complex dependencies among random variables, and building large-scale multivariate statistical models. Graphical models have become a focus of research in many statistical, computational and mathematical fields, including bioinformatics, communication theory, statistical physics, combinatorial optimizati...
متن کاملProbabilistic Inference and Monadic Second Order Logic
This paper combines two classic results from two different fields: the result by Lauritzen and Spiegelhalter [21] that the probabilistic inference problem on probabilistic networks can be solved in linear time on networks with a moralization of bounded treewidth, and the result by Courcelle [10] that problems that can be formulated in counting monadic second order logic can be solved in linear ...
متن کاملThe differential prior gives second order inference for scalar and vector parameters
Jeffreys (1946) proposed a root-information prior for the likelihood analysis of a statistical model. Then for an exponential model with scalar parameter Welch & Peers (1963) showed that this leads to second-order inference, or more specifically that posterior intervals have second order confidence. But for an exponential model with vector-parameter Jeffreys (1961) found that the root informati...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Pakistan Journal of Statistics and Operation Research
سال: 2012
ISSN: 2220-5810,1816-2711
DOI: 10.18187/pjsor.v8i3.518